Enabling Rendering of User-Specific Information using a Display Device

ABSTRACT

It is provided a method for enabling rendering of user-specific information using a display device, the method being performed by a user device comprising a camera, the user device being separate from the display device. The method comprises the steps of: determining a selected display device and creating a logical association between the user device and the selected display device; capturing at least one image of the display device using the camera; decoding the at least one image, resulting in decoded content; and rendering the decoded content for a user of the user device in a location corresponding to the selected display device.

TECHNICAL FIELD

The present disclosure relates to the field of the provision ofuser-specific information and in particular to enabling rendering ofuser-specific information using a display device which is separate froma user device.

BACKGROUND

In many public locations there are display devices that present visualcontent e.g. in the form of television content, context relevantinformation, advertisements or other types of information. Examples ofvenues using such display devices are airports, public transport (e.g.metro) stations, shopping malls and sports bars. The content of thedisplay device is visible to anyone within line of sight of the displaydevice.

One way to improve such display devices is to provide user-specificinformation to a user looking at the screen. There are solutionsavailable that provide such functionality; one such solution is providedby in a product called Parallel reality by MisappliedSciences, presentedat https://www.misappliedsciences.com/Home/Technology at the time offiling this patent application.

With Parallel reality, the LEDs (Light Emitting Diodes) in the publicscreen can be controlled to direct light in different directions, e.g.to a specific user. However, if many users are located in more or lessthe same direction relative the display device, there is a risk thatinformation intended for one user can be read by others (in similarpositions).

SUMMARY

One object is to improve how public display devices can be used forproviding user-specific information.

According to a first aspect, it is provided a method for enablingrendering of user-specific information using a display device, themethod being performed by a user device comprising a camera, the userdevice being separate from the display device. The method comprises thesteps of: determining a selected display device and creating a logicalassociation between the user device and the selected display device;capturing at least one image of the display device using the camera;decoding the at least one image, resulting in decoded content; andrendering the decoded content for a user of the user device in alocation corresponding to the selected display device.

The rendering may be performed using computer-generated visual content.

The step of rendering may comprise rendering the visual content suchthat the visual content at least partly covers the selected displaydevice.

The step of decoding may comprise demodulating data elements in the atleast one image, the data elements being visually provided by thedisplay device.

The step of decoding may comprise applying a descrambling code to thedata elements.

The data elements may be arranged in a two-dimensional space within thedisplay device in the at least one image, in which case the descramblingcode is in the form of a matrix corresponding to how the data elementsare arranged in the two-dimensional space.

The descrambling code may be orthogonal to one or more otherdescrambling codes, respectively used for other user devices by the samedisplay device.

The demodulating data elements may comprise demodulating the dataelements from light intensity variations in the at least one image.

The method may further comprise the step of: triggering the logicalassociation between the user device and the selected display device tobe communicated to a server.

The step of triggering the logical association may comprise transmittingthe logical association to the server.

The step of triggering the logical association may comprise triggeringthe selected display to transmit the logical association to the server.

According to a second aspect, it is provided a user device for enablingrendering of user-specific information using a display device, the userdevice being separate from the display device. The user devicecomprises: a camera; a processor; and a memory storing instructionsthat, when executed by the processor, cause the user device to:determine a selected display device and create a logical associationbetween the user device and the selected display device; capture atleast one image of the display device using the camera; decode the atleast one image, resulting in decoded content; and render the decodedcontent for a user of the user device in a location corresponding to theselected display device.

The instructions to render may comprise instructions that, when executedby the processor, cause the user device to render usingcomputer-generated visual content.

The instructions to render may comprise instructions that, when executedby the processor, cause the user device to render the visual contentsuch that the visual content at least partly covers the selected displaydevice.

The instructions to decode may comprise instructions that, when executedby the processor, cause the user device to demodulate data elements inthe at least one image, the data elements being visually provided by thedisplay device.

The instructions to decode may comprise instructions that, when executedby the processor, cause the user device to apply a descrambling code tothe data elements.

The data elements may be arranged in a two-dimensional space within thedisplay device in the at least one image, in which case the descramblingcode is in the form of a matrix corresponding to how the data elementsare arranged in the two-dimensional space.

The descrambling code may be orthogonal to one or more otherdescrambling codes, respectively used for other user devices by the samedisplay device.

The instructions to demodulate data elements may comprise instructionsthat, when executed by the processor, cause the user device todemodulate the data elements from light intensity variations in the atleast one image.

The user device may further comprise instructions that, when executed bythe processor, cause the user device to trigger the logical associationbetween the user device and the selected display device to becommunicated to a server.

The instructions to trigger the logical association may compriseinstructions that, when executed by the processor, cause the user deviceto transmit the logical association to the server.

The instructions to trigger the logical association may compriseinstructions that, when executed by the processor, cause the user deviceto trigger the selected display device to transmit the logicalassociation to the server.

According to a third aspect, it is provided a computer program forenabling rendering of user-specific information using a display deviceand a user device comprising a camera, the user device being separatefrom the display device. The computer program comprises computer programcode which, when executed on the user device causes the user device to:determine a selected display device and create a logical associationbetween the user device and the selected display device; capture atleast one image of the display device using the camera; decode the atleast one image, resulting in decoded content; and render the decodedcontent for a us of the user device in a location corresponding to theselected display device.

According to a fourth aspect, it is provided a computer program productcomprising a computer program according to the third aspect and acomputer readable means on which the computer program is stored.

According to a fifth aspect, it is provided a method for enablingrendering of user-specific information using a display device, themethod being performed by the display device comprising a display. Themethod comprises the steps of: determining an associated user device andcreating a logical association between the associated user device andthe display device, the display device being separate from theassociated user device; obtaining content to be provided to theassociated user device; encoding the content, resulting in dataelements; and providing the data elements using the display.

The step of encoding the content may comprise applying a scrambling codeto the content, resulting in data elements.

The step of encoding may comprise modulating the data elements usingintensity variations of picture elements in the display.

The encoding may comprise modulating data elements for a plurality ofuser devices.

Scrambling codes for different user devices may be orthogonal to eachother.

The data elements may be arranged in a two-dimensional space of thedisplay, in which case the scrambling code is in the form of a matrixcorresponding to how the data elements are arranged in thetwo-dimensional space.

The method may further comprise the step of: triggering the logicalassociation between the display device and the associated user device tobe communicated to a server.

The step of triggering the logical association may comprise transmittingthe logical association to the server.

The step of triggering the logical association may comprise triggeringthe associated user device to transmit the logical association to theserver.

According to a sixth aspect, it is provided a display device forenabling rendering of user-specific information using the displaydevice. The display device comprises: a display; a processor; and amemory storing instructions that, when executed by the processor, causethe display device to: determine an associated user device and creatinga logical association between the associated user device and the displaydevice, the display device being separate from the associated userdevice; obtain content to be provided to the associated user device;encode the content, resulting in data elements; and provide the dataelements using the display.

The instructions to encode the content may comprise instructions that,when executed by the processor, cause the display device to apply ascrambling code to the content, resulting in data elements.

The instructions to encode may comprise instructions that, when executedby the processor, cause the display device to modulate the data elementsusing intensity variations of picture elements in the display.

The instructions to encode may comprise instructions that, when executedby the processor, cause the display device to modulate data elements fora plurality of user devices.

Scrambling codes for different user devices may be orthogonal to eachother.

The data elements may be arranged in a two-dimensional space of thedisplay, in which case the scrambling code is in the form of a matrixcorresponding to how the data elements are arranged in thetwo-dimensional space.

The display device may further comprise instructions that, when executedby the processor, cause the display device to: trigger the logicalassociation between the display and the associated user device to becommunicated to a server.

The instructions to trigger the logical association may compriseinstructions that, when executed by the processor, cause the displaydevice to transmit the logical association to the server.

The instructions to trigger the logical association may compriseinstructions that, when executed by the processor, cause the displaydevice to trigger the associated user device to transmit the logicalassociation to the server.

According to a seventh aspect, it is provided a computer program forenabling rendering of user-specific information using a display devicecomprising a display. The computer program comprises computer programcode which, when executed on a display device causes the display deviceto: determine an associated user device and creating a logicalassociation between the associated user device and the display device,the display device being separate from the associated user device;obtain content to be provided to the associated user device; encode thecontent, resulting in data elements; and provide the data elements usingthe display.

According to an eighth aspect, it is provided a computer program productcomprising a computer program according to the seventh aspect and acomputer readable means on which the computer program is stored.

Generally, all terms used in the claims are to be interpreted accordingto their ordinary meaning in the technical field, unless explicitlydefined otherwise herein. All references to “a/an/the element,apparatus, component, means, step, etc.” are to be interpreted openly asreferring to at least one instance of the element, apparatus, component,means, step, etc., unless explicitly stated otherwise. The steps of anymethod disclosed herein do not have to be performed in the exact orderdisclosed, unless explicitly stated.

BRIEF DESCRIPTION OF THE DRAWINGS

Aspects and embodiments are now described, by way of example, withreference to the accompanying drawings, in which:

FIG. 1 is a schematic diagram illustrating an environment in whichembodiments presented herein can be applied;

FIGS. 2A-B are perspective views illustrating embodiments applied in avehicle;

FIGS. 3A-B are flow charts illustrating embodiments of methods of a userdevice for enabling rendering of user-specific information using adisplay device;

FIGS. 4A-B are flow charts illustrating embodiments of methods of adisplay device for enabling rendering of user-specific information usinga display device;

FIG. 5 is a schematic diagram illustrating components of the user deviceof FIG. 1 and FIGS. 2A-B according to one embodiment;

FIG. 6 is a schematic diagram illustrating components of the displaydevice of FIG. 1 and FIGS. 2A-B according to one embodiment;

FIG. 7 is a schematic diagram showing functional modules of the userdevice of FIG. 1 and FIGS. 2A-B according to one embodiment;

FIG. 8 is a schematic diagram showing functional modules of the displaydevice of FIG. 1 and FIGS. 2A-B according to one embodiment; and

FIG. 9 shows one example of a computer program product comprisingcomputer readable means.

DETAILED DESCRIPTION

The aspects of the present disclosure will now be described more fullyhereinafter with reference to the accompanying drawings, in whichcertain embodiments of the invention are shown. These aspects may,however, be embodied in many different forms and should not be construedas limiting; rather, these embodiments are provided by way of example sothat this disclosure will be thorough and complete, and to fully conveythe scope of all aspects of invention to those skilled in the art. Likenumbers refer to like elements throughout the description.

FIG. 1 is a schematic diagram illustrating an environment in whichembodiments presented herein can be applied. In this scenario, there aretwo user devices 2 a, 2 b and a display device 1. It is to be noted thatembodiments presented herein are applicable for any number of userdevices and display devices.

The user devices 2 a, 2 b and the display device 1 are connected to thesame communication network 6. The communication network 6 can containwide area network components, such as the Internet and/or cellularnetworks. Additionally or alternatively, the communication network 6contains short-range communication links, e.g. based on Bluetooth, WiFi(IEEE 802.11x), etc. Alternatively or additionally, the user devices 2a, 2 b can communicate with the display device over a short-rangecommunication protocol, e.g. Bluetooth Low Energy (BLE), Bluetooth,Ultrawideband (UWB), Near-Field Communication (NFC), Radio FrequencyIdentification (RFID) or any other suitable communication protocol.

A server 3 is also connected to the communication network 6. The server3 can be located locally or remotely in relation to the user devices 2a, 2 b and the display device 1. The server 3 controls content whichincludes user-specific information for at least one of the two users 7a-b, which is to be provided using the display device 1.

The user devices 2 a, 2 b are close to each other, such that there isline-of sight between the user devices 2 a, 2 b and the display device1. The user devices 2 a, 2 b are implemented using any suitable userdevice comprising a camera 11 and a rendering device which is capable ofrendering computer generated visual content as an overlay over (real oran image of) real-word objects. In this embodiment, the user devices 2a, 2 b are illustrated as smart glasses. However, the user devices 2 a,2 b can be implemented using any suitable device that is capable ofrendering content such that the user can see a combination of real-worldobjects and the rendered content, e.g. using any mixed reality (virtualreality/augmented reality) device, e.g. smart glasses, smart contactlenses, smartphone/tablet computer that combines images from camera withcomputer-rendered content, smart windscreen of a car, etc.

A first user 7 a wears the first user device 2 a and a second user 7 bwears the second user device 2 b.

The display device 1 comprises a display 1 to convey public visualinformation on its display 15. The display device 1 can be used in anysuitable public space, e.g. shopping centres, in street space, inairports.

According to the embodiments presented herein, the display device 1 isused to convey the user-specific information from the server 3 to eitherone of the users 7 a, 7 b. This is achieved by including encodeduser-specific information in the visual content shown by the displaydevice 1. The user devices 2 a, 2 b extract this data using the camera11. Each user device 2 a, 2 b extracts only data intended for that userdevice 2 a, 2 b. The extracted data is then rendered for the user 7 a, 7b using the respective user device 2 a, 2 b. The rendered data isrendered such that it overlays the display device 1.

This allows, from the perspective of each user 7 a, 7 b, user-specificinformation from the server 3 to be presented on the display device.This can be used in a plethora of different scenarios.

In a first scenario, the display device 1 can be used in an airportsetting, where the user-specific information is used to indicate to theuser what gate to go to, estimated boarding time and to indicate adirection to the gate. If time is short, attention-grabbing graphics(e.g. colours, animations, blinking, etc.) can be applied to emphasizeto the user to immediately go to the gate.

The server 3 can be configured for each user 7 a, 7 b whether to usefunctionality of user-specific information via public display devices.In other words, some users may not want to use this functionality andopt out, which is recorded in the server 3. Alternatively, user needs toactively register as a user, i.e. opt in, of this functionality, beforeit is provided to the user.

The user-specific information can be provided using data elements whichare transmitted by the display device by modulating the data elements bymeans of intensity variations of picture elements in the display. Eachdata element can be a subset of the user-specific information. In oneembodiment, the light intensity is varied by turning pixels or groups ofpixels on and off. In one embodiment, the light intensity is varied byonly setting pixels or groups of pixels to a specific intensity whichcan be on, off or somewhere in between. The variations of lightintensity can be applied such that it is not visible or is negligiblefor regular people that look at the display device 1.

FIGS. 2A-B are perspective views illustrating embodiments applied in avehicle. A user 7 drives a vehicle 18 along a road 20.

In this example, there is a first display device 1 a, a second displaydevice 1 b and a third display device 1 c, respectively provided by afirst side road 21 a, a second side road 21 b and a third side road 21c. The user 7 needs to turn into one of the side roads 21 a-c but doesnot know which one. In this example, the user 7 needs to exit onto thesecond side road 21 b. Using a conventional navigation system is notoptimal since the side roads 21 a-c are close to each other and it maybe difficult to direct the user 7 to pick the correct side road 21 b.This type of situation can e.g. occur at an airport when the user 7needs to return a rental vehicle to a specific car rental company.

In the scenario of FIG. 2A, the user wears smart glasses 2. The displays1 a-1 c are here illustrated in the way that the user experiences themthrough visual content overlaid using the smart glasses 2.

In this example, visual content is rendered on each one of the threedisplay devices 1 a-c to guide the user to the correct (second) sideroad 21 b. Specifically, the first display device 1 a is rendered withvisual content illustrating that the user should not enter the firstside road 21 a, e.g. with visual content showing a large ‘X’, e.g. incolour red to further emphasize that the user 7 should not enter thefirst side road 21 a, or a forward arrow (not shown). Analogously, thethird display device 21 c is rendered with visual content in the form ofa large ‘X’ to indicate that the user 7 should not enter the third sideroad 21 c. In contrast, the second display device 21 b is rendered withvisual content in the form of a left arrow to indicate that the user 7should enter the second side road 21 b. The arrow can be in the colourgreen to further emphasize that the user 7 should enter the second sideroad 21 b.

It is to be noted that the ‘X’s and the arrow are only displayed visiblefor the specific user 7 using the smart glasses 2.

Looking now to FIG. 2B, the same visual content as in FIG. 2A isrendered for the use. In FIG. 2B, though, the visual content is renderedusing a smart windscreen of the vehicle. In this example, the vehicle(or the wind screen with rendering capability) is the user device 2. Thesmart windscreen allows computer-rendered content to be presented to theuser in positions which correspond to the display devices 1 a-1 c. Usingthe smart windscreen, the user does not need to wear or carry anyspecific device.

FIGS. 3A-B are flow charts illustrating embodiments of methods of a userdevice for enabling rendering of user-specific information using adisplay device. The user device comprises a camera.

In a determine display device step 40, the user device determines aselected display device and creates a logical association between theuser device and the selected display device.

In one embodiment, the user device reads a code which is modulated inthe visual content shown by the display device. The code can be a formof pilot code that identifies the display device. The pilot can betransmitted at regular intervals indefinitely to allow user devices todetermine the identity of the display device. Alternatively oradditionally, the user device or another user device (e.g. a wearabledevice, such as a smartwatch or smart jewellery) connects over ashort-range wireless link with the display device. The short-rangewireless link can e.g. be based on BLE, Bluetooth, UWB, NFC, RFID or anyother suitable communication protocol. The identity of the displaydevice is then obtained using the short-range wireless link. In oneembodiment, the user device captures a sound or an infrared signal fromthe display device to obtain its identity. In one embodiment, thedisplay device shows a QR (Quick Response) code (or has a QR stickeradjacent) for identification of the display device by the user device.In one embodiment, a user is registered as a user of this functionalityby registering a code, such as e.g. a QR code on an airplane ticket. Thecode in combination with positioning of the user device or determinationthat the user device is in close vicinity of a specific display devicecould be used for determining a suitable display device.

In all of these embodiments, the user device can only obtain theidentity of the display device when the user device is in the proximityof the display device.

In a capture image(s) step 44, the user device captures at least oneimage of the display device using the camera. For instance, a videocontaining a series of images can be captured to allow informationmodulated in the visible data provided by the display to be received bythe user device.

In a decode step 46, the user device decodes the at least one image,resulting in decoded content.

The decoding can comprise demodulating data elements in the at least oneimage. Hence, the data elements are provided visually by the displaydevice. The term visually is here to be interpreted as using visiblelight. The data elements might thus not be distinguishable for a humanwith or without a user device even though they are encoded visually.

The decode step 46 may comprise applying a descrambling code to the dataelements. The descrambling code allows data to be conveyed in parallelto several user devices. Alternatively or additionally, the descramblingcode is used to spread the data elements across the available visualspace of the display device.

In one embodiment, the data elements are arranged in a two-dimensionalspace within the display device in the at least one image. Thedescrambling code is then in the form of a matrix corresponding to howthe data elements are arranged in the two-dimensional space.

The descrambling code can be orthogonal to one or more otherdescrambling codes, respectively used for other user devices by the samedisplay device. This allows independent conveying of user-specificinformation to the respective user devices.

The demodulating of the data elements can comprise demodulating the dataelements from light intensity variations in the at least one image.

In a render content step 48, the user device renders the decoded contentfor a user of the user device in a location corresponding to theselected display device. The rendering can be performed usingcomputer-generated visual content.

The visual content can be rendered such that the visual content at leastpartly covers the selected display device. In other words, the overlaidvisual content can block any other content shown on the selected displaydevice, e.g. replacing all public (i.e. not user-specific) visualcontent actually shown by the selected display device with the renderedvisual content.

Looking now to FIG. 3B, only new or modified steps compared to the stepsof FIG. 3A will be described.

In an optional trigger communication of association step 42, the userdevice triggers the logical association between the user device and theselected display device to be communicated to a server. This triggeralerts the server of the association between the user device and theselected display device. In this way, the server knows which displaydevice to communicate with to convey the user-specific information for acertain user. For instance, the logical association can be transmittedto the server by the user device. Alternatively or additionally, theselected display device is triggered (e.g. using a signal from the userdevice to the selected display device) to transmit the logicalassociation to the server.

In an alternative to the user device selecting a suitable displaydevice, a display device could select a user device to be used to conveythe user-specific information.

FIGS. 4A-B are flow charts illustrating embodiments of methods of adisplay device for enabling rendering of user-specific information usinga display device. The display device comprises a display. The userdevice is separate from the display device.

In a determine user device step 50, the display device determines anassociated user device and creating a logical association between theassociated user device and the display device. The display device isseparate from the associated user device.

The display device can identify the associated user device by receivinginformation of the user device identifying of the display device, asexplained above for the determine external display device step 40. Forinstance, the display device can receive the identity of the associateduser device from the server or directly from the associated user device.

Alternatively, the display device identifies the user device directly,e.g. using a camera on the display device. The user device can then beidentified e.g. by transmitting light pattern or a QR code that iscaptured by the display device.

In an obtain content step 54, the display device obtains content to beprovided to the associated user device. The content can be a messageprovided from the server to the associated user device, triggered by theserver when the server is made aware of the connection between thedisplay device and the associated user device. The content can containtext, still or dynamic images and/or graphics. The server selects one ormore appropriate display devices which are associated with the userdevice. For instance the display device in the current or projectedlocation of the associated user device can be selected. Optionally, theserver triggers other display devices (which may be too far away fromthe associated user device to show the actual user-specific information)to display arrows pointing to the display device which transmits theuser-specific information, in a form of geofencing.

In an encode content step 56, the display device encodes the content,resulting in data elements. The encoding of the content can compriseapplying a scrambling code to the content. Each data element can containa subset of the content. Optionally, each data element is encrypted forthe associated user device.

The data elements can then be modulated using intensity variations ofpicture elements in the display. Data elements can be modulating for aplurality of user devices in parallel, to support the transmission ofdata to several user devices, and thereby several users, in parallel.The modulation can comprise applying the light variations intermittentlyin order to keep visible artefacts low for other persons looking at thedisplay.

Scrambling codes for different user devices can be orthogonal to eachother. For instance, when arranged sequentially, the data elements canbe provided in different slots, e.g. modulo n with an offset thatdiffers for each user device.

In one embodiment, the scrambling codes are similar in principle tothose of (W)CDMA (Wideband Code Division Multiple Access. In a (W)CDMAsystem, all UEs (User Equipment) use the same spectrum but aredifferentiated by codes.

The data elements can be arranged in a two-dimensional space of thedisplay, in which case the scrambling code is in the form of a matrixcorresponding to how the data elements are arranged in thetwo-dimensional space.

For instance, the data elements could be presented by the display devicewithin an available space of 10×10 pixel groups. The available space isthen used to multiplex data elements to several user devices.

A first scrambling code for a first user device can then be:

0 1 1 0 1 0 1 0 0 0 0 0 0 0 0 1 1 1 1 1 1 0 1 0 0 0 0 0 1 0 1 0 0 0 0 11 0 1 1 1 0 1 1 1 0 0 0 1 1 0 0 1 0 0 1 0 1 0 1 1 1 1 0 1 0 0 1 0 1 0 10 1 1 0 1 1 0 1 1 1 1 0 1 0 1 0 1 1 0 0 1 1 1 1 1 1 0 1

At the same time, a second scrambling code for a second user device canbe:

1 0 0 1 0 1 0 1 1 1 1 1 1 1 1 0 0 0 0 0 0 1 0 1 1 1 1 1 0 1 0 1 1 1 1 00 1 0 0 0 1 0 0 0 1 1 1 0 0 1 1 0 1 1 0 1 0 1 0 0 0 0 1 0 1 1 0 1 0 1 01 0 0 1 0 0 1 0 0 0 0 1 0 1 0 1 0 0 1 1 0 0 0 0 0 0 1 0

The first user device applies the first scrambling code and the seconduser device applies the second scrambling code. Hence, in order to senddata to the first user device, the display device provides data elementsfor the first user device only in those pixel groups where thecorresponding scrambling code element is ‘1’. The same procedure is usedto supply data to the second user device.

Since the scrambling codes allow data to be transmitted separately, thefirst and second scrambling codes are orthogonal to each other.

In a provide data elements step 58, the display device provides the dataelements using the display.

Optionally, when it is determined that the user stops looking at thedisplay device (determined e.g. by accelerators and/or gyros of the userdevice), the user device transmits this determination to the displaydevice, indicating that the user has seen the user-specific information.The display device interprets this as an acknowledgement of receiveddata and the display device stops sending the user-specific information.

Looking now to FIG. 4B, only new or modified steps compared to the stepsof FIG. 4A will be described.

In an optional trigger communication of association step 52, the displaydevice triggers the logical association between the display device andthe associated user device to be communicated to a server. For instance,the logical association can be transmitted to the server by the displaydevice. Alternatively or additionally, the associated user device istriggered (e.g. using a signal from the display device to the userdevice) to transmit the logical association to the server.

Using embodiments presented herein, user-specific information can beprovided using public display devices. Rather than, as is the case withtraditional augmented reality, providing information overlaid right infront of the user, the information is here rendered in a positioncorresponding to the display device, where the user expects to findrelevant information. By using the display device to encode theinformation, a secure and private provision of information to a specificuser device (and thus user) is achieved. The information is digital, soencryption can be applied if needed.

FIG. 5 is a schematic diagram illustrating components of the user device2 of FIG. 1 and FIGS. 2A-B according to one embodiment. The user deviceis capable of providing computer-rendered visual content overlaid overreal-word objects. For instance, the user device 2 can be in the form ofan augmented-reality renderer, which overlays visual content over whatis seen by the user, e.g. in the form of smart glasses, illustrated inFIG. 1 , smart contact lenses, or in the form of a smart windscreen,illustrated in FIGS. 2A-B.

A processor 60 is provided using any combination of one or more of asuitable central processing unit (CPU), multiprocessor, microcontroller,digital signal processor (DSP), etc., capable of executing softwareinstructions 67 stored in a memory 64, which can thus be a computerprogram product. The processor 60 could alternatively be implementedusing an application specific integrated circuit (ASIC), fieldprogrammable gate array (FPGA), etc. The processor 60 can be configuredto execute the method described with reference to FIGS. 3A-B above.

The memory 64 can be any combination of random-access memory (RAM)and/or read-only memory (ROM). The memory 64 also comprises persistentstorage, which, for example, can be any single one or combination ofmagnetic memory, optical memory, solid-state memory or even remotelymounted memory.

A data memory 66 is also provided for reading and/or storing data duringexecution of software instructions in the processor 60. The data memory66 can be any combination of RAM and/or ROM.

The user device 2 further comprises an I/O interface 62 forcommunicating with external and/or internal entities.

A camera 11 is any suitable image capturing device which is capable ofcapturing visual of real-world objects of its environment and providethe captured image to the processor 60 for further processing. Forinstance, the camera 11 can be implemented as a conventionaltwo-dimensional digital camera.

A rendering device 12 is a device capable of rendering visual contentfor the user, which is overlaid real-world objects in some manner. Inone embodiment, the visual content is overlaid over captured real-worldobjects on one screen, e.g. on a smartphone or tablet computer, wherebythe screen then shows a combination of image data from the camera of theuser device and rendered visual content.

Other components of the user device 2 are omitted in order not toobscure the concepts presented herein.

FIG. 6 is a schematic diagram illustrating components of the displaydevice 1 of FIG. 1 and FIGS. 2A-B according to one embodiment. Thedisplay device 1 can e.g. be embodied as a public information displaydevice, e.g. used in airports, as road information and/or foradvertising.

A processor 160 is provided using any combination of one or more of asuitable central processing unit (CPU), multiprocessor, microcontroller,digital signal processor (DSP), etc., capable of executing softwareinstructions 167 stored in a memory 164, which can thus be a computerprogram product. The processor 160 could alternatively be implementedusing an application specific integrated circuit (ASIC), fieldprogrammable gate array (FPGA), etc. The processor 160 can be configuredto execute the method described with reference to FIGS. 4A-B above.

The memory 164 can be any combination of random-access memory (RAM)and/or read-only memory (ROM). The memory 164 also comprises persistentstorage, which, for example, can be any single one or combination ofmagnetic memory, optical memory, solid-state memory or even remotelymounted memory.

A data memory 166 is also provided for reading and/or storing dataduring execution of software instructions in the processor 160. The datamemory 166 can be any combination of RAM and/or ROM.

The display device 1 further comprises an I/O interface 162 forcommunicating with external and/or internal entities.

A display 15 is provided, which can be capable of both displayinggeneral visual content, as well as modulated visual content, asdescribed with reference to FIGS. 4A-B above.

Other components of the display device 1 are omitted in order not toobscure the concepts presented herein.

FIG. 7 is a schematic diagram showing functional modules of the userdevice 2, 2 a-b of FIG. 1 and FIGS. 2A-B according to one embodiment.The modules are implemented using software instructions such as acomputer program executing in the user device. Alternatively oradditionally, the modules are implemented using hardware, such as anyone or more of an ASIC (Application Specific Integrated Circuit), anFPGA (Field Programmable Gate Array), or discrete logical circuits. Themodules correspond to the steps in the methods illustrated in FIGS.3A-B.

A display determiner 70 corresponds to step 40. An associationcommunicator 72 corresponds to step 42. An image capturer 74 correspondsto step 44. A decoder 76 corresponds to step 46. A content renderer 78corresponds to step 48.

FIG. 8 is a schematic diagram showing functional modules of the displaydevice 1, 1 a-c of FIG. 1 and FIGS. 2A-B according to one embodiment.The modules are implemented using software instructions such as acomputer program executing in the display device. Alternatively oradditionally, the modules are implemented using hardware, such as anyone or more of an ASIC (Application Specific Integrated Circuit), anFPGA (Field Programmable Gate Array), or discrete logical circuits. Themodules correspond to the steps in the methods illustrated in FIGS.4A-B.

A user determiner 80 corresponds to step 50. An association communicator82 corresponds to step 52. A content obtainer corresponds to step 54. Acontent encoder 86 corresponds to step 56. A data element provider 88corresponds to step 58.

FIG. 9 shows one example of a computer program product 90 comprisingcomputer readable means. On this computer readable means, a computerprogram 91 can be stored, which computer program can cause a processorto execute a method according to embodiments described herein. In thisexample, the computer program product is in the form of a removablesolid-state memory, e.g. a Universal Serial Bus (USB) drive. Asexplained above, the computer program product could also be embodied ina memory of a device, such as the computer program product 64 of FIG. 5or the computer program product 164 of FIG. 6 . While the computerprogram 91 is here schematically shown as a section of the removablesolid-state memory, the computer program can be stored in any way whichis suitable for the computer program product, such as another type ofremovable solid-state memory, or an optical disc, such as a CD (compactdisc), a DVD (digital versatile disc) or a Blu-Ray disc.

The aspects of the present disclosure have mainly been described abovewith reference to a few embodiments. However, as is readily appreciatedby a person skilled in the art, other embodiments than the onesdisclosed above are equally possible within the scope of the invention,as defined by the appended patent claims. Thus, while various aspectsand embodiments have been disclosed herein, other aspects andembodiments will be apparent to those skilled in the art. The variousaspects and embodiments disclosed herein are for purposes ofillustration and are not intended to be limiting, with the true scopeand spirit being indicated by the following claims.

1.-44. (canceled)
 45. A user device for enabling rendering ofuser-specific information using a display device, the user device beingseparate from the display device, the user device comprising: a camera;a processor; and a memory storing instructions that, when executed bythe processor, cause the user device to: determine a selected displaydevice and create a logical association between the user device and theselected display device; capture at least one image of the displaydevice using the camera; decode the at least one image, resulting indecoded content; and render the decoded content for a user of the userdevice in a location corresponding to the selected display device. 46.The user device according to claim 45, wherein the instructions thatcause the user device to render the decoded content compriseinstructions that, when executed by the processor, cause the user deviceto render the decoded content using computer-generated visual content.47. The user device according to claim 45, wherein the instructions thatcause the user device to decode the at least one image compriseinstructions that, when executed by the processor, cause the user deviceto demodulate data elements in the at least one image, the data elementsbeing visually provided by the display device.
 48. The user deviceaccording to claim 47, wherein the instructions that cause the userdevice to decode the at least one image comprise instructions that, whenexecuted by the processor, cause the user device to apply a descramblingcode to the data elements.
 49. The user device according to claim 48,wherein the data elements are arranged in a two-dimensional space withinthe display device in the at least one image and the descrambling codeis in the form of a matrix corresponding to how the data elements arearranged in the two-dimensional space.
 50. The user device according toclaim 48, wherein the descrambling code is orthogonal to one or moreother descrambling codes, respectively used for other user devices bythe same display device.
 51. The user device according to claim 47,wherein the instructions that cause the user device to decode the atleast one image comprise instructions that, when executed by theprocessor, cause the user device to demodulate the data elements fromlight intensity variations in the at least one image.
 52. The userdevice according to claim 45, wherein the instructions, when executed bythe processor, further cause the user device to trigger the logicalassociation between the user device and the selected display device tobe communicated to a server.
 53. The user device according to claim 52,wherein the instructions that cause the user device to trigger thelogical association to be communicated to the server compriseinstructions that, when executed by the processor, cause the user deviceto: transmit the logical association to the server; or trigger theselected display device to transmit the logical association to theserver.
 54. A method for enabling rendering of user-specific informationusing a display device, the method being performed by a user devicecomprising a camera, the user device being separate from the displaydevice, the method comprising: determining a selected display device andcreating a logical association between the user device and the selecteddisplay device; capturing at least one image of the display device usingthe camera; decoding the at least one image, resulting in decodedcontent; and rendering the decoded content for a user of the user devicein a location corresponding to the selected display device.
 55. Adisplay device for enabling rendering of user-specific information usingthe display device, the display device comprising: a display; aprocessor; and a memory storing instructions that, when executed by theprocessor, cause the display device to: determine an associated userdevice and creating a logical association between the associated userdevice and the display device, the display device being separate fromthe associated user device; obtain content to be provided to theassociated user device; encode the content, resulting in data elements;and provide the data elements using the display.
 56. The display deviceaccording to claim 55, wherein the instructions that cause the displaydevice to encode the content comprise instructions that, when executedby the processor, cause the display device to apply a scrambling code tothe content, resulting in data elements.
 57. The display deviceaccording to claim 56, wherein the instructions that cause the displaydevice to encode the content comprise instructions that, when executedby the processor, cause the display device to modulate the data elementsusing intensity variations of picture elements in the display.
 58. Thedisplay device according to claim 57, wherein the instructions thatcause the display device to encode the content comprise instructionsthat, when executed by the processor, cause the display device tomodulate data elements for a plurality of user devices.
 59. The displaydevice according to claim 58, wherein scrambling codes for differentuser devices are orthogonal to each other.
 60. The display deviceaccording to claim 56, wherein the data elements are arranged in atwo-dimensional space of the display and the scrambling code is in theform of a matrix corresponding to how the data elements are arranged inthe two-dimensional space.
 61. The display device according to claim 55,wherein the instructions, when executed by the processor, further causethe display device to trigger the logical association between thedisplay and the associated user device to be communicated to a server.62. The display device according to claim 61, wherein the instructionsthat cause the display device to trigger the logical association to becommunicated to a server comprise instructions that, when executed bythe processor, cause the display device to: transmit the logicalassociation to the server; or trigger the associated user device totransmit the logical association to the server.
 63. A method forenabling rendering of user-specific information using a display device,the method being performed by the display device comprising a display,the method comprising: determining an associated user device andcreating a logical association between the associated user device andthe display device, the display device being separate from theassociated user device; obtaining content to be provided to theassociated user device; encoding the content, resulting in dataelements; and providing the data elements using the display.